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STORAGE MEDIUM FOR RECORDING SUBTITLE INFORMATION BASED ON TEXT 
CORRESPONDING TO AV DATA HAVING MULTIPLE PLAYBACK ROUTES, REPRODUCING 

APPARATUS AND METHOD THEREFOR 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of PCT International Patent Application 
No. PCT/KR2004/002481. filed September 24, 2004, Korean Patent Application No. 2004-4442, 
filed January 20, 2004, in the Korean Intellectual Property Office, and Korean Patent Application 
No. 2003-67919, filed September 30, 2003, in the Korean Intellectual Property Office, the 
disclosures of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

T e chn i ca l F iel d l. Field of the Invention 

[0002] Ibe- Aspects of the present invention fetates- relate to reproduction of astorage 
medium recording moving picture data, and more particularly, to a storage medium recording 
subtitle information compatible with a subpicture method of a digital versatile disc (DVD) and a 
presentation method of a bluray disc, and based on text corresponding to moving picture data 
having a plurality of playback rout e s, and routes. Other aspects of the invention relate to an 
r e produc i ng apparatus for and a r e produc i ng method of reproducing a moving picture from the 
moving picture data on the storage mediumt hefefef. 

Background Art 2. Description of the Related Art 

[0003] Among conventional text-based subtitle technologies th e r e are Synchronized 
Accessible Media Interchange (SAMI) technology of Microsoft Corporation and Real-text 
technology of RealNetwork , Inc. . These conventional text-based subtitle technologies are 
based on a video stream data file recorded on a storage medium or a video stream data file 
provided on a network, and have a structure in which a subtitle is output based on th o bas i s of 
synchronization time information with video data. 

[0004] FIG.1 is a reference diagram explaining the conventional text-based subtitle 
technology. Referring to FIG 1 , ther e is a text-based subtitle file A corresponding to video stream 
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data, and on th e bas i s o f based on synchronization time informationjs included in a subtitle filer 
file. fe^ For example, at <sync time 00:05>, tbe-a_subtitle corresponding to video stream data is 
output. _That is, the conventional text-based subtitle information provides a subtitle file structure 
constructed assuming that continuous video data is reproduced. 

[0005] FIG. 2 is a reference diagram explaining problems of the conventional text-based 
subtitle technology. Referring to FIG. 2, with the conventional text-based subtitle file structure, 
th e r e i s a prob le m that when ajnultiple story video having a plurality of playback routes is 
reproduced according to a user input, processing subtitles according to alternate routes of the 
multiple story video is impossible using the synchronization time information as shown in the 
figwe FIG. 2 . That is, only story route A can be reproduced, and story route B cannot be 
reproduced. 

[0006] In addition, th e r e i s anoth e r probl e m that the conventional text-based subtitle data is 
not compatible with subtitle data based on a bitmap image such as a subpicture method of a 
DVD or a presentation method of a bluray disc. 

Disclosur e of I nv e ntion SUMMARY OF THE INVENTION 
T e chnica l Prob le m 

Th e r e i s a prob le m that when mult i pl e story v i d e o having a plura li ty of p l ayback rout e s is 
r e produc e d accord i ng to a us e r input, proc e ss i ng subt i t le s i s i mposs i bl e . I n addit i on, th e r e i s 
anoth e r prob le m that th e conv e ntiona l t e xt - bas e d subtit le data i s not compat i b le w i th s ubt i t le 
data bas e d on a b i tmap imag e such as a subp i ctur e m e thod of a DVD or a pr e s e ntat i on m e thod 
of a bluray d i sc. 

T e chnica l So l ut i on 

[0007] To solve the above and/or other problems, i t is a first ob je ctiv e o f aspects of the 
present invention to prov i d e provide a storage medium recording subtitle information compatible 
with a subpicture method of a DVD and a presentation method of a bluray disc, aod-based on 
text corresponding to moving picture data having a plurality of playback rout e s, and rgutes^ 
Additional aspects of the invention provide a n apparatus for reproducing apparatus and a 
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reproduc i ng method of reproducing therefe fcompatible with the subpicture method of the DVD 
and the presentation method of the blurav disc , 

[0008] To accomp l ish th e first obj e ct i v e of th e pr e s e nt inv e ntion, th e r e is prov i d e d According 
to an aspect of the present invention a storage medium i nc l ud i ng includes : moving picture data 
having a plurality of playback routes; a plurality of subtitle data items corresponding to the 
playback routes and supporting random search for a subtitle; and mapping information linking 
the moving picture data and the subtitle data. 

[0009] The subtitle data may include reference offset information indicating reference 
information to randomly search for a subtitle of a desired time at a high speed and reproduce 
the subtitle, text data containing subtitle contents that are converted into pixel data and output, 
style information specifying an output style of the pixel data, and control information to control 
the output of the converted pixel data. 

[0010] By using information on a time elapsed from the reference offset information, the 
subtitle of a desired time may be randomly searched for at a high speed among the subtitle 
data. The reference offset information may include a cell identifier (VOBJD and CELLJD) of a 
video object that is a recording unit of the storage medium, or a start position of a clip that is a 
recording unit of the storage medium. 

[001 1] The subtitle data may be described in tbe-aform of a markup language or a form of a 
binary table. In the subtitle data described in the form of a-the binary table, the style 
information, the control information, and the text information may have respective identifiers for 
distinguishing each other, and the control information may include indication information 
indicating the style information and the text information corresponding to the control information, 
and in order to reduce a search time by integer calculation when random search is performed^ 
the size of each of the style information and the control information may be predetermined and 
sequentially recorded in a predetermined area. 

[0012] The style information may include at least one among information items on the width 
and height of the pixel data area, a background color, a time when the pixel data is to be stored 
and deleted in a buffer memory, a starting point from which subtitle text is rendered A line 
spacing, output direction, bold type and Italic type of subtitle text, line break, color of subtitle 
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text, and information on character code encoding. As used herein, an expression of the form at 
least one among A, B, and C includes A or B or C, A and B, A and C, B and C, and A and B and 

<L 

[0013] The control information may include at least one among information items on an area 
on which the pixel data is to be output on the entire screen, a start point of subtitle text in the 
pixel data output area, and a synchronization time indicating when the pixel data is to appear 
and disappear in synchronization with the moving picture data. 

[0014] The tbe-synchronization time information may be expressed as a lapse time from a 
reference cell (CELL) of a video object (VOBU) that is reference offset information of the moving 
picture data, or as a lapse time from a start position of a clip that is reference offset information 
of the moving picture data. 

[0015] The synchronization time information may be expressed by using a present time 
stamp (PTS) time based on th e bas i s of a reference time for reproducing moving pictures. 

[0016] The subtitle data or mapping information may further include at least one among font 
information describing the font of subtitle data to be displayed on the screen, information on a 
producer making the subtitle, packet identifier (PID) information of the subtitle data to distinguish 
from the moving picture data, and subtitle indication information by language of the subtitle data. 

[0017] To accomplish th e s e cond obj e ct i v e of th e pr e s e nt i nvention, th e r e i s 
prov i d e d According to another aspect of the present invention, a reproducing apparatus for 
reproducing a storage medium on which moving picture data is recorded th e apparatus 
i nc l ud i ng includes : a decoder decoding moving picture data having a plurality of playback routes; 
and a subtitle processor converting subtitle data A corresponding to a predetermined route and 
selected by using a plurality of subtitle data items corresponding to the playback routes and 
supporting random search for a subtitle and mapping information linking the moving picture data 
and the subtitle data, into pixel data, and-synchronizing the converted pixel data with the moving 
picture data x and outputting the pixel data. 

[0018] The subtitle processor may include: a text subtitle decoder identifying subtitle data 
corresponding to the moving picture data of a route to be reproduced by parsing the mapping 
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information, and converting the identified subtitle data into pixel data by parsing the subtitle 
data; and a graphic controller controlling the pixel data by using the parsed mapping information 
and subtitle data such that the pixel data is synchronized with the moving picture data and 
output. 

[0019] In the subtitle data, by decoding the subtitle data, the text subtitle decoder may parse 
reference offset information indicating reference information to randomly search for a subtitle of 
a desired time at a high speed and reproduce the subtitle, text data containing subtitle contents 
that are converted into pixel data and output, style information specifying an output style of the 
pixel data, and control information to control the output of the converted pixel data, and based 
on the style information, convert the text data into pixel data, and by using the parsed control 
information, the graphic controller may control such that the converted pixel data is 
synchronized with the moving picture data and output. 

[0020] The text subtitle decoder may randomly search the subtitle data for the subtitle of a 
desired time at a high speed by using information on a time elapsed from the reference offset 
information. 

[0021] By using synchronization time information expressed as a lapse time from a reference 
cell (CELL) of a video object (VOBU) that is reference offset information of the moving picture 
data, or as a lapse time from a start position of a clip that is reference offset information of the 
moving picture data, the graphic controller may control the converted pixel data to be 
synchronized with the moving picture data and output. 

[0022] A l so, to accompl i sh the s e cond obj e ct i v e of th e pr e s e nt i nv e nt i on, th e r e i s 
prov i d e d According to an aspect of the present invention, another method fef-of/eproducing 
data on a storage medium storing moving picture data having a plurality of playback routes, a 
plurality of subtitle data items corresponding to the playback routes and supporting random 
search for a subtitle, and mapping information linking the moving picture data and the subtitle 
data, th e m e thod i nclud i ng includes : reading the subtitle data corresponding to moving picture 
data of a route to be reproduced by parsing the mapping information; identifying subtitle data of 
a position to be reproduced according to continuous reproduction or reproduction by random 
search, by parsing the subtitle data, and converting the subtitle data into pixel data; and 
synchronizing the converted pixel data with the moving picture data and outputting the pixel 
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data. 

Advantag e ous Eff e cts 

[0023] By using the mapping information and the subtitle data file structure according to the 
aspects of the present invention, subtitle information compatible with a bitmap image method 
such as the subpicture method of a DVD and the presentation method of a bluray disc, and 
based on text corresponding to moving picture data having a plurality of playback routes A can be 
provided. 

[0024] Furthermofe, by including reference offset information in a subtitle data file, when 
random search or reproduction is performed^ the time for searching for a subtitle can be 
reduced such that search efficiency can be is enhanced. 

[0025] Additional aspects and/or advantages of the invention will be set forth in part in the 
description which follows and, in part, will be obvious from the description, or may be learned by 
practice of the invention. 

D e scr i ption of Draw i nqs BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] These and/or other aspects and advantages of the invention will become apparent 
and more readily appreciated from the following description of the embodiments, taken in 
conjunction with the accompanying drawings of which: 

FIG. 1 is a reference diagram explaining tbe-a_conventional text-based subtitle 
technology; 

FIG. 2 is a reference diagram explaining problems of the conventional text-based subtitle 
technology illustrated in FIG. 1 ; 

FIG 3 is a reference diagram explaining text-based subtitle information corresponding to 
moving picture data having a plurality of playback routes according to a pr e ferr e d an 
embodiment of the present invention; 

F I GS. A through 10 ar e diagram e xp l a i n i ng mapping information of mov i ng pictur e data 
and subt i tl e data hav i ng a p l ura li ty of playback rout e s and th e structuro of oubtit le data 
accord i ng to a pr e f e rr e d e mbod i m e nt of th e pr e s e nt i nv e nt i on; 

A l so, FIGS. 11 through 17 ar e diagrams e xp l aining an imp le m e ntat i on e xamp le of 
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mapp i ng i nformat i on and subt i t le data impl e m e nt e d on a DVD d is c a s a pr e f e rr e d e mbod i m e nt 
of th e pr e s e nt i nv e ntion; 

M e anwh ile , F I GS. 18 through 24 ar e d i agrams e xp l ain i ng an i mpl e m e ntat i on e xampl e of 
mapp i ng i nformat i on and s ubtitl e data i mp le m e nt e d on a bluray d i sc as anoth e r pr e f e rr e d 
e mbod i m e nt of th e pr e s e nt inv e nt i on; 

Mor e sp e c i f i ca ll y, FIG. 4 is a diagram explaining mapping information of moving picture 
data and subtitle data having a-the plurality of playback routes shown in FIG. 3 accord i ng to a 
pr e f e rr e d e mbodim e nt of th e pr e s e nt i nv e nt i on ; 

FIG. 5 is a diagram explaining subtitle indication information by language corresponding 
to moving picture data having a-the plurality of playback route s according to a pr e f e rr e d 
e mbodim e nt of th e pr e s e nt i nv e nt i on ; 

FIG 6 is a diagram explaining tbe-a_structure of subtitle data accord i ng to a pr e f e rr e d 
e mbodim e nt of th e pr e s e nt i nvention ; 

FIG. 7 is a diagram explaining a usage example of each field of subtitle data having the 
data structure ef- shown in FIG. 6; 

FIG 8 is a diagram explaining tbe-a_structure of a reproducing apparatus according to an 
pr e f e rr e d embodiment of the present invention; 

FIG. 9 is a diagram explaining tbe-a_structure of a-the subtitle processor ef- shown in FIG. 
8 i n detai l; 

FIG. 10 is a flowchart of th e st e ps p e rform e d by a r e produc i ng amethod fef-ot providing 
reproducing subtitle information based on text corresponding to moving picture data having a 
plurality of playback routes according to an pr e f e rr e d embodiment of the present invention; 

FIG. 11 is a diagram explaining the data structure of mapping information shown in FIG. 
4 implemented on a DVD disc as an e mbod i m e nt of th e pr e s e nt inv e nt i on ; 

FIG 12 is a diagram showing an example of the mapping information shown in FIG. 11 
implemented by using a markup language on a DVD disc as an e mbodim e nt of th e pr e s e nt 
i nv e ntion ; 

FIG. 13 is a diagram showing an example of the mapping information shown in FIG. 11 
described in the form of a table implemented on a DVD disc as an e mbod i m e nt of th e pr e s e nt 
i nv e nt i on ; 

FIG 14 is a diagram explaining the structure of subtitle data shown in FIG. 6 
implemented on a DVD disc as an e mbod i m e nt of th e pr e s e nt i nv e ntion ; 
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FIGS. 15A and 15B are diagrams showing an example of the subtitle data shown in FIG. 
6 implemented on a DVD disc displayed on a screen as a pr e f e rr e d e mbod i m e nt of th e pr e s e nt 
i nv e nt i on ; 

FIG. 16 is a diagram showing an example of the subtitle data shown in FIG. 6 
implemented by a markup language on a DVD disc as an e mbod i m e nt of th e pr e s e nt i nv e nt i on ; 

FIG 17 is a diagram showing an example of the subtitle data shown in FIG. 6 
implemented in th e form of a binary table on a DVD disc as an e mbodim e nt of th e pr e s e nt 
i nv e ntion ; 

FIG. 18 is a diagram explaining the data structure of the mapping information shown in 
FIG. 4 implemented on a bluray disc as anoth e r e mbodim e nt of th e pr e s e nt i nv e nt i on ; 

FIG. 19 is a diagram showing an example of the mapping information shown in FIG 18 
implemented by using a markup language on a bluray disc as anoth e r e mbod i m e nt of th e 
pr e s e nt i nv e nt i on ; 

FIG. 20 is a diagram showing an example of the mapping information shown in FIG 18 
implemented in d e scrib e d i n th e form of a table i mp le m e nted on a bluray disc as anoth e r 
e mbodim e nt of th e pr e s e nt inv e nt i on ; 

FIG. 21 is a diagram explaining the structure of the subtitle data shown in FIG. 6 
implemented on a bluray dis c as anoth e r e mbod i m e nt of th e pr e s e nt i nv e ntion ; 

FIGS. 22A and 22B are diagrams showing an example of the subtitle data shown in FIG. 
6 implemented on a bluray disc displayed on a screen as anoth e r pr e ferr e d e mbod i m e nt of th e 
pr e s e nt i nv e ntion ; 

FIG 23 is a diagram showing an example of the subtitle data shown in FIG. 6 
implemented by a markup language on a bluray disc as anoth e r embod i m e nt of th o pr e s e nt 
i nv e nt i on ; and 

FIG. 24 is a diagram showing an example of the subtitle data shown in FIG 6 
implemented in th e form of a binary table on a bluray disc as anoth e r e mbod i m e nt of th e 
pres e nt i nv e ntion . 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

[0027] Reference will now be made in detail to the present embodiments of the present 
invention, examples of which are illustrated in the accompanying drawings, wherein like 
reference numerals refer to the like elements throughout. The embodiments are described 
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below in order to explain the present invention by referring to the figures. 
B e st Mod e 

[0028] FIGS. 3 through 7_4©-are diagrams explaining mapping information of moving picture 
data and subtitle data having a plurality of playback routes and the structure of subtitle data 
according to an pr e f e rr e d embodiment of the present invention. 

[0029] FIGS. 8 and 9 are diagrams explaining a structure of a reproducing apparatus 
according to an embodiment of the present invention and FIG. 10 is a flowchart of a method of 
reproducing subtitle data according to an embodiment of the present invention 

[0030] Ateor-FIGS. 11 through 17 are diagrams explaining an impl e m e ntat i on example of the 
mapping information and subtitle data implemented on a DVD disc as a pr e f e rr e d e mbod i m e nt 
(1) of th e pr e s e nt i nv e ntion . 

[0031] M e anwhi le , FIGS. 18 through 24 are diagrams explaining an i mpl e m e ntat i on _example 
of mapping information and subtitle data implemented on a bluray disc as anoth e r pr e f e rr e d 
e mbod i m e nt (2) of th e pr e s e nt i nv e nt i on . 

[0032] F i rst, according to a pr e f e rr e d e mbodiment of th e pr e s e nt i nvent i on, a A storage 
medium recording text-based subtitle information bas e d on t e xt corresponding to moving picture 
data having a plurality of playback routes, and a reproducing apparatus and a reproducing 
method therefor will now be explained. The storage medium accord i ng to a pr e f e rr e d 
e mbod i m e nt of th e pres e nt i nv e ntion has comprises a structure including moving picture data 
having a plurality of playback routes for multiple story playback, a plurality of subtitle data items 
corresponding to the plurality of playback routes and supporting random search for a subtitle, 
and mapping information linking the moving picture data and the subtitle data d e scr i b e d abov e. 

FIG. 3 is a r e f e r e nc e d i agram e xp l a i n i ng t e xt - bas e d s ubtit le i nformat i on corr e spond i ng to mov i ng 
p i ctur e data having a p l ura li ty of p l ayback rout e s accord i ng to a pr e f e rr e d e mbod i m e nt of the 
pres e nt i nv e nt i on. 

[0033] Referring to FIG. 3, in order to select and reproduce story A route or story B route for 
multiple story playback, video data A and video data B are linked to video data C. F I G. 4 i s a 
d i agram e xp l a i ning mapping i nformat i on of mov i ng p i ctur e data and subt i tl e data having a 
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plura l ity of p l ayback rout e s accord i ng to a pref e rr e d ombodim e nt of th e pr e s e nt i nvention. 

[0034] Ref e rr i ng to F I G. 4 . shown is FIG. 4 shows mapping information for linking moving 
picture data having a plurality of playback routes and a plurality of subtitle data corresponding to 
the moving picture data in order to support multiple story playback. That i s, mapp i ng The 
mapping information on th e le ft hand sid e includes Subtitle Indication Information for subtitle 
data items (A through O A, B and C, corresponding to eaeh-video data items , A, B and C, 
respectively, (A through C) . Accord i ng to th i s. wh i ch e v e r Accordinglv, where a user selects 
between playback of the story A route and playback of the story B route, the video data and the 
corr e spond i ng subtitle data corresponding to the selection pan- may be output continuously. 

[0035] FIG. 5 is a diagram explaining Subtitle Indication Information by language 
corresponding to moving picture data having a plurality of playback routes accord i ng to a 
pr e f e rr e d e mbodim e nt of th e pr e s e nt i nv e nt i on . Referring to FIG. 5, subtitle indication 
information by language accord i ng to th e pr e s e nt i nv e nt i on indicates related mapping 
information for individual subtitle languages supported. Atso Further , the mapping information 
indicates a plurality of subtitle data items corresponding to a plurality of playback routes, 
respectively, as described above with reference to FIG. 4. 

[0036] For example, as shown in FIG. 5, if in a storage medium providing English, Korean, 
and Japanese subtitles, the Korean subtitle is selected by a user selection, or as-ais_set as a 
default, by th e point e r of r el at e d mapping ind i cat i on i nformat i on, subtitle/video mapping 
information Y supporting the Korean subtitle is linked by a pointer of related mapping indication 
information . Also, a plurality of the subtitle data A . B and through C written in the corr e sponding 
languag e Y. that i s. i n Korean language , are linked to A , B and through C video data items 
having a plurality of playback routes included in subtitle/video mapping information Y, 
respectively. Accordingly, multiple language subtitles are supported and at the same time, 
multiple story playback of moving picture data having a plurality of playback routes is enabled. 

[0037] FIG. 6 is a diagram explaining the-astructure of subtitle data according to an pr o forr e d 
embodiment of the present invention. R o forr i ng to F I G. 6, shown i s FIG. 6 shows the structure of 
a plurality of subtitle data linked by related subtitle indication information included in the 
subtitle/video mapping information described above with reference to FIG. 4. _The subtitle data 
accord i ng to a pr e f e rr e d e mbod i m e nt of th e present i nvent i on includes header information, 
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reference offset information, time information and/or text information. -Rfsk- The header 
information is information on the entire subtitle data and may include position information of a 
subtitle to be displayed on a screen, and international standard record code ( h e r ei naft e r r e f e rred 
to as ISRC) as information on a producer or a support language code. 

[0038] R e f e r e nc e The reference offset information is reference information for randomly 
searching for a subtitle of a desired time at a high speed and reproducing the subtitle. A cell 
identifier (VOB-ID and CELL J D) of a video object (VOBU) used as a recording unit of a DVD 
storage medium, or the starting point of a clip used as a recording unit of a bluray disc storage 
medium ean -mav be used as the reference offset information. 

[0039] Synchronization time information synchronizing a subtitle with video data can- may be 
expressed as a lapse time from a starting point of a reference cell of a VOBU or a clip that is 
reference offset information of the moving picture data. In particular, synchronization time 
information pan-may be expressed by using a presentation time stamp ( h e r e inaft e r r e f e rr e d to 
as-PTS) time based on th e bas i s of a reference time for reproducing moving pictures. 

[0040] Text information indicates text data containing subtitle contents to be converted into 
pixel data to present a bitmap image of the text subtitle and output . A l so, th eThe text 
information may include style information specifying the-an output style of pixel data and control 
information for contro ll ing to control the output of the converted pixel data. The style information 
and control information will be explained later. 

[0041] FIG. 7 is a diagram explaining a usage example of each field of subtitle data having 
the data structure of FIG. 6. Referring to F I G. 7, The field subtitle data shown in FIG. 7 
accord i ng to a pr e f e rr e d e mbod i m e nt of th e pr e sent inv e nt i on includes position information of a 
subtitle to be displayed on a screen, a language code and/or ISRC information as header 
information. A l so, th eThe subtitle data includes a plurality of synchronization time information 
items synchronizing the subtitle with video data, and a plurality of text information items of a 
subtitle to be used as subtitle contents. Furthermefe, the subtitle data includes reference offset 
information for random search for a subtitle, and each reference offset information item 
indicates an immediate next reference offset information item. Accordingly, by using reference 
offset information, a subtitle Gafhmay.be searched for at a high speed and synchronization time 
information for synchronizing a subtitle with video data can also be expressed by a lapse time 
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from reference offset information. 

[0042] The storage medium accord i ng to th e present inv e nt i on as described above with 
respect to FIGS. 3-7 includes moving picture data having a plurality of playback routes, a 
plurality of subtitle data corresponding to the plurality of playback routes, and subtitle/video 
mapping information for multiple story playback. Atse^ The subtitle data includes reference 
offset information for high speed random search. I n add i t i on, in |n order to support multiple 
language subtitles, subtitle indication information by language oafi- mav also be furtbef-included. 
The subtitle/video mapping information, subtitle data, and subtitle indication information by 
language above described GafHnav be recorded as files separate from thejnoving picture data, 
and can -may be recorded on an i dent i ca l a same storage medium on which moving picture data 
is recorded or ean- mav be recorded separately in a server or the like on the Internet. 

[0043] Based on the data structure of the storage medium described above, th e structur e of 
a n apparatus for reproducing the storage medium r e produc i ng apparatus accord i ng to th e 
pr e s e nt inv e nt i on w ill now be e xp l ain e d described . .FIG. 8 is a diagram explaining tbe-a_structure 
of a reproducing apparatus according to an pr e f e rr e d embodiment of the present invention. 

[0044] R e f e rr i ng to F I G. 8, th eThe reproducing apparatus shown in FIG. 8 according to th e 
pr e s e nt i nv e ntion includes a reading unit 810, a decoder 830, a subtitle processor 840, and a 
blender 850. Also, the reproducing apparatus may further include a buffer unit 820 temporarily 
storing data for buff e r i ng to buffer the data. 

[0045] The reading unit 810 reads e ach data items having the data structure described 
above from a storage medium or from the Internet 800, and depending on the-atype of each 
data item, stores the data in a corresponding buffer unit 820. That is, AV stream data is stored 
in a moving picture data buffer 822, a plurality of subtitle data items corresponding to a plurality 
of playback routes (Refer to FIG. 6) are stored in a subtitle data buffer 824, and subtitle/video 
mapping information (Refer to FIG. 4) and subtitle indication information by language (Refer to 
FIG 5) are stored in toe-a_corresponding buffer 826. Furthermefe, font information of a subtitle 
is stored in a default font buffer 828. Moanwhilo, a A resident font buffer 842 storing a resident 
font read from a-the storage medium or from the Internet and residing on a memory san-may 
also be d i spo se d included. 
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[0046] The decoder 830 decodes video stream data stored in the moving picture data buffer 
822 and transmits moving pictures to be output to the blender 850. The subtitle processor 840 
generates a graphic image of a subtitle to be overlaid on moving pictures to be output, and 
controls the output of a subtitle to be synchronized with video data. That is, the subtitle 
processor 840 receives subtitle data from the subtitle data buffer 824, receives mapping 
information from the subtitle/video mapping information buffer 826, and identifies subtitle data 
corresponding to the moving picture data corresponding to a selected language and a selected 
story route. By decoding the subtitle data, the subtitle processor 840 converts (or renders) the 
subtitle data into pixel data for a bitmap image and transmits the pixel data to the blender 850. 
At th i s tim e , by By using style information included in the subtitle data, the output style of the 
subtitle eafh mav be controlled and by using control information included in the subtitle data, an 
output time of the subtitle data safh mav be controlled to be synchronized with the video data. 

[0047] Font information stored in the default font buffer 828 and/or the resident font buffer 
842 Gafl- mav be used. A detailed structure of the subtitle processor 840 wW-beis explained 
latef below . 

[0048] Rendering in the present invention indicates all required activities related to converting 
subtitle text data into graphic data to express the text data on a display apparatus. That is,_4t 
the rendering indicates all processes for finding a font matching a character code of each 
character in text data, from download font data read from an information storage medium, or 
from the resident font data, converting into a graphic, and outputting on a screen. 

[0049] The blender 850 receives decoded video data from the decoder 830, receives 
converted pixel data from the subtitle processor 840, overlays the pixel data of a subtitle on an 
image based on the video data, and outputs to the display apparatus 860. 

[0050] FIG. 9 is a diagram explaining the structure of the subtitle processor 840 of FIG. 8 in 
detail. .Referring to FIG. 9, the subtitle processor 840 according to the pr e sent i nv e ntion 
includes a text subtitle decoder 902 and a graphic controller 904. 

[0051] The text subtitle decoder 902 receives subtitle data, subtitle/video mapping 
information, other language information, and font information from the buffers 824 and 826 
d e scr i b e d abov e, parses the subtitle/video mapping information, identifies subtitle data 
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corresponding to the_moving picture data of a route to be reproduced^ parses the identified 
subtitle data, and converts the identified subtitle data into pixel data for a bitmap image graphic. 

[0052] By using the subtitle/video mapping information and subtitle data parsed by the text 
subtitle decoder 902, the graphic controller 904 controls an output time and position of the 
converted pixel data such that the converted pixel data is output synchronized with the moving 
picture data. 

[0053] More specifically, the text subtitle decoder 902 decodes subtitle data, and parses 
reference offset information indicating reference information for randomly searching at a high 
speed for a subtitle of a desired time among subtitle data, and data and reproducing the subt i tl e , 
text subtitle; text data including subtitle contents to be converted into pixel data and then output, 
stv teoutput; style information specifying an output style of pixel data; and control information for 
controlling the output of the converted pixel data. Also, bas e d Based on the parsed style 
information, text data is converted into pixel data. 

[0054] A l so, th eThe graphic controller 904 controls based on the parsed control information 
such that t o output the converted pixel data is-synchronized with moving picture data and output . 
An output time point or an output position eafh mav be included in the control information. 

[0055] A method of reproducing m e thod subtitle data according to th e pr e s e nt i nv e nt i on 
based on the data structure recorded on a storage medium according to a pr e f e rr e d 
e mbodim e nt of th e pr e s e nt i nv e nt i on and the structure of the reproducing apparatus described 
above will now be explained. 

[0056] FIG. 1 0 is a flowchart of th e st e ps p e rform e d by a method of reproducing m e thod for 
prov i d i ng text-based subtitle information bas e d on t e xt corresponding to moving picture data 
having a plurality of playback routes according to an pr e f e rr e d embodiment of the present 
invention. Referring to FIG. 10, in order to support multiple language subtitles and multiple story 
playback, ftfstr-a subtitle indication information item corresponding to a language selected by a 
user or set as a default in a reproducing apparatus is read among subtitle indication information 
by language (Refer to FIG. 5) in step- operation 1002. By parsing subtitle indication information 
corresponding to the selected language, linked subtitle/video mapping information is read in 
step- operation 1004. By parsing the read subtitle/video mapping information, subtitle data 
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linked to video data of a route to be reproduced is read in step -operation 1006. Based on style 
information and text information included in the read subtitle data, pixel data for a bitmap image 
graphic is generated in step- operation 1008. F i na ll y, by By controlling a time and position for 
outputting a subtitle based on control information included in the subtitle data, the generated 
pixel data is output in step- operation 1010. 

[0057] Accordingly, the subtitle of the language selected by the user or as a default setting 
Gaf wnav be reproduced along the story playback route. At th i s tim e , s ubt i t le Subtitle indication 
information by language, subtitle/video mapping information, or subtitle data cafi- mav be 
recorded on an i d e nt i ca l a same storage medium on which moving picture data is recorded or 
cafh mav be disposed separately, such as for example, on the Interne t s e parat el y, and in th e 
l att e r cas e , th e at an Internet address on th e I nt e rn e t can be stored on a-the storage medium. 

[0058] Meanwhi le , ref e rr i ng Referring to FIGS. 11 through 17, an imp le m e ntat i on e xample of 
implementing the mapping information and subtitle data i mp le m e nt e d on a DVD disc , as an 
e mbodim e nt (1) of th e pr e s e nt i nvent i on will now be explained. 

[0059] On a DVD disc, a video manager (VMG) in which header information on the entire 
video title is recorded and a plurality of video title sets (VTS) are stored. A video object set 
( here i naft e r r o f o rr o d to as VOBS) is linked to the VMG. M o anwh il o, to th e VTS, a A VOBS for 
displaying a menu screen and a plurality of video objects (VOBs) are linked to the VTS . 
M e anwhi le , aA VOB is formed with a plurality of Cells, and each cell is formed with a plurality of 
video object units (VOBUs). 

[0060] In information for navigation of video data, VOBU_VOB_IDN information and 
VOBU_C_IDN information are recorded such that a video object to which a current VOBU unit 
belongs and identifier of a Cell (VOBJD and CELLJD) eafh mav be known. Also, cell elapsed 
time( C ELTM) information is recorded such that a relative reproduction time from the first video 
frame of a Cell to which a current VOBU belongs, to the first video frame of the current VOBU 
Gafl -mav be known. 

[0061] Mapping information and the structure of subtitle data accord i ng to th e pr e s e nt 
i nv e nt i on based on the DVD disc structure described above will now be explained. .FIG. 11 is a 
diagram explaining the data structure of mapping information shown in FIG. 4 implemented on a 
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DVD disc as an e mbodim e nt (1) of th e pr e s e nt invention . Referring to FIG. 11 , a storag e 
m e d i um accord i ng to th e pr e s e nt i nvent i on the DVD disc includes a video object VOB that is a 
recording unit of moving picture data of a DVD and indication information on subtitle data linked 
to the VOB. 

[0062] Subtitle/video mapping information on th e le ft hand s i d e includes indication 
information indicating a VOBS linked to at least one or more subtitles. Also, information 
indicating linking relations between VOBSs is also included. 

[0063] B e s i d e s. The subtitle/video mapping information includes at least one is inc l ud e d 
among language information dang ="xx") on which language is used to generate the subtitle 
data, screen display title information of a subtitle (caption - "vv") , information on at least one er 
more fonts font (font = "zz") , ISRC code information of a producer who made subtitles (isrc = 
"aa") , color table information to be used for a background color and foreground color of a 
subtitle character (palette "pp") . and stream number information of a text subtitle (streamed = 
"id") to distinguish i^ the stream number information of the text subtitle from subtitle stream data 
of a subpicture method in AV stream data that is moving picture data. The stream number 
information of a text subtitle may include, for example, a number set to SPRM (2), which is a 
system register of a reproducing apparatus. 

[0064] FIG. 12 is a diagram showing an example of mapping information shown in FIG. 11 
implemented by using a markup language on a DVD disc as an e mbod i m e nt (1) of th e pr e sent 
i nv e nt i on . Ref e rr i ng to As shown in FIG. 12, i t can b e s ee n that video object 1 in <vmg_vobs> 
tag is linked to a subtitle data file 1202, file://English_vmgm.text, video object 1 in <vtms_vobs> 
tag is linked to a subtitle data file 1204, file://EngIish_vtsm.text, and video object 1-9 in 
<vtstt_vobs> tag is linked to a subtitle data file 1206, file://English_tt1vob1 .text. B o s i d es , ln 
addition to language information, title information, font information, ISRC information, stream 
IDs, and color table information are included. 

[0065] The example tefe- shown in FIG 12 uses the XML method but other encoding 
methods can- may also be used for presentation. That is, i n th e pr e s e nt i nvent i on, wh i ch the data 
shou l d \obe used is o f primary importance, and the method f©f-crf_expressing the data cafi- may 
b e p e rform e d by s el ect i ng to use a markup language, ©f-a binary table, or another method. 
Data that eafi -mav be included in subtitle/video mapping information ean- mav be arranged as 
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follows. 

[0066] FIG. 13 is a diagram showing an example of implementing the mapping information 
d e scr i b e d on a DVD disc in tbe-a_form of a table, i mp le m e nt e d on a DVD d i sc as an 
e mbodim e nt (1) of th e pres e nt inv e nt i on. ^ Referring to FIG. 13, position information 1302,1304, 
and 1306 of subtitle data corresponding to a video object is included. B e s i d e s. ln addition to 
language information, title information, font information, ISRC information, color table 
information, and stream ID information eafl- mav be included. 

[0067] M e anwh i l e , i n ]n a-the DVD, subtitle data to be displayed overlapping a video image is 
encoded in tbe-asame manner as 2-dimensional graphic data i s e ncod e d . That is, in the case 
of a DVD, a separate encoding method to support multiple languages is not employed and data 
for each subtitle data-is converted into pixel data for a bitmap image graphic, and then the pixel 
data is processed by one encoding method and recorded. Graphic data for a subtitle is referred 
to as a subpicture. A subpicture is formed with a subpicture unit (SPU) corresponding to one 
sheet of graphic data. As output control information to output pixel data, output starting time 
information, color information of pixel data, information on contrast with video data, and 
information on an output time and a finish time are included. 

[0068] FIG. 14 is a diagram explaining the structure of subtitle data shown in FIG 6 
implemented on a DVD disc as an e mbodim e nt (1) of th e pr e s e nt i nv e nt i on . .Referring to FIG. 
14, the structure of the subtitle data shown in FIG. 6 according to an e mbodim e nt (1) of th e 
pr e s e nt inv e nt i on includes header information, reference offset information, time information 
and/or text information. The header H e ad e r information and text information are the same as 
explained with reference to FIG. 6 and a description thereof will not be repeated . 

[0069] However, the reference offset information is reference information to randomly search 
for a subtitle of a desired time at a high speed and reproduce the subtitle, and uses the cell 
identifier (VOBJDN and CELLJDN) of the video object (VOB) described above, which is used 
as a recording unit of a DVD storage medium. Also, as synchronization time information, a 
lapse time from a starting time point of a reference cell is used. In particular, synchronization 
time information eafh mav be expressed by using a presentation time stamp (PTS) time based 
on th e bas i s of a reference time to reproduce moving pictures. B e s i d e s, s Style information 
specifying the output style of pixel data and control information for controlling output of 
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converted pixel data eafh mav also be included. The style information and control information 
will be explained laterbelgw. 

[0070] FIGS. 15A and 15B are diagrams showing an example of subtitle data implemented 
on a DVD disc displayed on a screen as a pr e f e rr e d embod i m e nt (1) of th e pr e s e nt inv e ntion . 

[0071] In a DVD, pixel data is losslessly coded and information on a position at which a 
subpicture of a subtitle is displayed (SP display area) in an area to display the entire screen, 
and information for controlling an output start time and finish time, an output direction, and line 
spacing are included. In a DVD, subpicture data for subtitle data of a maximum of 32 different 
languages eafh mav be multiplexed together with moving picture data and recorded. Each 
language is distinguished by a stream id provided by the MPEG system coding method, and a 
sub stream id defined by the DVD. Accordingly, if a user selects one language, the 
corresponding subpicture unit (SPU) is extracted by taking only subpictures (SP_PCK) having 
the stream id and sub stream id corresponding to the language, and then, by decoding the 
subpicture unit (SPU), subtitle data is extracted and according to output control information, the 
output is controlled. 

[0072] Referring to FIGS. 15A and 15B, tbe-a_method fef-otdisplaying a-the text-based 
subtitle accord i ng to th e pr e s e nt i nv e nt i on constructed to have compatibility with the subpicture 
method of a DVD disc is shown. Jhe subtitle data described with reference to FIG. 14 is parsed 
by the subtitle processor 840 of FIG. 8 and converted into pixel data having an output image as 
shown in FIGS. 15A and 15B, and transferred to the blender 850. Accordingly, the reproducing 
apparatus accord i ng to th e present i nv e nt i on shown in FIG. 8 eafhreceives the pixel data for a 
bitmap image accord i ng to th e pr e s e nt i nv e ntion as the conventional bitmap-based subpicture 
data, synchronizes it- the pixel data w ith the video data and output s an image corresponding to 
the video data and the synchronized pixel data on the screen. As a result, without modifying the 
structure of the conventional decoder 830, a subtitle eafh mav be processed to be compatible 
with the conventional subpicture method. 

[0073] The text-based subtitle data described above according to tho prosont i nv e nt i on 
has mav comprise the following structure in order to be compatible with the subpicture method of 
a DVD as described above. 
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[0074] FIG. 16 is a diagram showing an example of subtitle data implemented by a markup 
language on a DVD d i sc as an e mbod i m e nt (1) of th e pr e s e nt inv e nt i on . Referring to FIG. 16, 
when text-based subtitle data is randomly searched for, in order to search for the data at a high 
speed a-the storage medium accord i ng to th e pr e s e nt i nv e nt i on uses a video object number 
(VOBJDN), a cell number (CELLJDN), and a lapse time from a cell (time) as reference offset 
information (1600). A l so, i nformat i on lnformation indicating next reference offset information 
(next) is included. Text A lso, t e xt information including the contents of a subtitle and style 
information indicating an output style are included (1602 and 1606). . Furth e rmor e , contro l 
Control information for outputting pixel data obtained by converting a text subtitle after 
synchronization with video data is also included (1604 and 1608). 

[0075] Pr e f e rab l y, i n ln order to generate the pixel data as shown in FIGS. 15A and 1 5B 
based on the subtitle data of FIG. 16, style information as the following is included in the text- 
based subtitle data according to the present invention. 

[0076] I t i s des i rab le that i n s ty leStyle information included in subtitle data accord i ng to the 
pr e s e nt i nv e nt i on, informat i on mav also include information on the-a_width and ajieight of a pixel 
data area to indicate the size of the pixel data i s r e cord e d . Pr e ferab l y, a l so Also included are 
information on tbe-acolor of a background screen of pixel data rendering subtitle text, time 
information on when pixel data is to be generated and deleted in the buffer memory of pixel 
data, information on a starting point from which the first line of subtitle text begins, information 
on line spacing when a plurality of lines of subtitle text are output, information indicating whether 
the output direction of text is from left to right or from right to left, or in the vertical or horizontal 
direction, information on the shape, such as size, bold and Italic, of subtitle text, line break 
information, and character code change information. 

[0077] The subtitle processor 830 parses style information in subtitle data having the 
information described above and controls the output style of the subtitle text. M e anwhil e , 
pr e f e rably, i n ln order to control so that pixel data converted by applying the style information 
described above is synchronized with video data and output on the screen, the following control 
information is included. 

[0078] Pref e rably, i n The4he control information inc l ud e d in the subtitle data accord i ng to th e 
pr e s e nt invent i on, posit i on used to generate the pixel data shown in FIGS. 15Aand 15B includes 



19 



Docket No.: 0001.1157 
Substitute Specification 
with markings 

position information ((Xs, Ys), (Xe, Ye)) specifying an area to bo actua l ly output the pixel data on 
the screen among pix el data , information on a starting point in a-the pixel data area 
corresponding to the first starting point of a text subpicture display area (Text SP Display Area) 
shown in FIG. 15A, and time information on when the bitmap image of pixel data appears and 
disappears on the screen ar e r e cord e d . 

[0079] I n FIG. 16. shown FIG. 16 illustrates is-subtitle data information 1 600 which A when 
vobjd is any one of 1 to 5 and celljd is 1 , a subtitle is mad e to b e output by calculating a 
synchronization time (sync time) based on th e bas i s of vobjdn=1-5 and cell_idn=1 . That is, by 
using a lapse time (time) from the video object number (VOBJDN) and cell number 
(CELLJDN) that are reference offset information, when text-based subtitle data is randomly 
searched for, retrieval eaf mnav be quickly performed. 

[0080] AteeA <text> tag indicates style information and subtitle text information and a 
< pixmap> tag indicates control information for outputting pixel data. 

[0081] As 'begin' or 'end' information of the <pixmap> tag or the <text> tag, a lapse time from 
a Cell or PTS time information calculated from the standard time clock (STC) described above is 
appropriate. Also, 'start' information of the <text> tag indicates address information of a starting 
point from which text is rendered, and 'start' information of the < pixmap> tag indicates 
information on an address from which the pixel data is to be output. 

[0082] In addition, as an example of control information, synchronization time information for 
outputting subtitle data synchronized with video data can- may be expressed as a lapse time 
from a reference cell of a video object, and in particular, screen output time (Presentation Time 
Stamp, PTS) information based on a-the STC used by a reproducing apparatus to reproduce 
video data eafh mav be used. 

[0083] The example shown in FIG. 16 uses the XML method . However but th i o i s just an 
e xampl e and the contents of subtitle data including style information and control information, 
reference offset information and header information, described above can- may be expressed by 
other encoding methods. 

[0084] A case where subtitle data is expressed by a binary table method not by th e XML 
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m e thod w ill now be explained. FIG. 17 is a diagram showing an example of subtitle data 
implemented in tbe-aform of a binary table on a DVD disc ao an o mbod i mont (1) of the pr e s e nt 
i nv e nt i on . Referring to FIG. 17, unlike in FIG. 16, an example of subtitle implemented in the 
form of a binary table shape is shown. As shown in FIG. 17, subtitle Subt i tl e data accord i ng to 
th e pr e s e nt i nvent i on includes style information 1710, control information 1720, ami-text 
information 1730, and i nc l ud es header information indicating starting positions of these 
i nformat i on i t e ms the style information 1710, the control information 1720 and the text 
information 1730 . In p i xmap Pixmap #1 (1 71 2) as-is_an example of control informat i on, 
informat i on information 1720 and includes information indicating the-a_position of style 
information (style = T) and tbe-a_position of text information (text_offset = T) is i nc l ud e d . 
Accord i ng to th i s Accordinglv , corresponding subtitle text information eaf^ mav be found and by 
applying the ind i cat e d style information 1710 , pixel data eafh mav be generated and based on 
the control information 1720 , the output of the generated pixel data is- mav be controlled. 

[0085] In particular, by implementing each of the style information 1710 and the control 
information 1720 to have a predetermined size and to be stored sequentially in a predetermined 
area, search time for random search and reproduction can b eis reduced compared to the 
conventional XML structure such as SAMI technology and Real-text technology, such that 
efficiency of search is enhanced. 

[0086] Meanwhile. r e f e rr i ng Referring to FIGS. 1 8 through 24, an example of implementing 
i mpl e m e ntation e xampl e of mapping information and subtitle data i mp le m e nt e d on a bluray disc 
as anoth e r embod i m e nt (2) of th e pr e s e nt i nv e ntion will now be explained. 

[0087] In a bluray disc, an AV stream in which moving picture data is recorded is divided into 
clip units and recorded. In addition, according to a presentation method similar to the 
subpicture method of a DVD, subtitle data is converted into pixel data based on a bitmap and 
processed. 

[0088] Implementing the data The-structure of subtitle data and mapping information shown 
in FIG. 4 according to th e pres e nt i nv e nt i on bas e d on the bluray disc structure will now be 
explained. F I G. 18 is a d i agram e xp l ain i ng th e data structur e of mapp i ng i nformat i on shown i n 
F I G. A imp l om e nt e d on a bluray d i 6C as anothor e mbodim e nt (2) of th e prosont i nv e nt i on. 
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[0089] Referring to FIG. 18, a storage medium accord i ng to th e pr e s e nt i nv e nt i on includes a 
clip that is a recording unit of moving picture data of a bluray disc and indication information 
indicating subtitle data 1802 linked to the clip. 

[0090] Subtitle/video mapping information on th e le ft hand sid e includes indication 
information indicating a clip linked to at least one or more subtitles. B e s i d e s, at l east on e 
amono- The subtitle/video mapping information includes language information dang ="xx") on 
which language is used for subtitle data, screen display title information of a subtitle (caption = 
"yy") , information on at least one or more fonts (font = "zz") , ISRC code information of a 
producer making the subtitle (irsc = "aa") , color table information to be used for a background 
color and a foreground color of a subtitle character (palette "pp") , and information on a packet 
identifier ( her ei naft e r r e f e rr e d to as PID) number of a text subtitle (pid="id n ) to distinguish from 
subtitle stream data in the subpicture method in AV stream data that is moving picture data4s 
inc l ud e d . The PID number information of a text subtitle can include, for example, a number set 
to PSR (2), which is a Player Status Register. 

[0091] FIG. 19 is a diagram showing an example of mapping information shown in FIG. 18 
implemented by using a markup language on a bluray disc as anoth e r e mbodim e nt (2) of th e 
pr e s e nt i nv e nt i on . R e f e rr i ng to As shown in FIG. 19, it can b e s e en that subtitle clip file 0001 in 
<blu-ray-video> tag is linked to subtitle data file 1902, 'english_0001.text.' Besidee Additionallv , 
language information, title information, font information, ISRC information, information on the 
PID number of a subtitle, and color table information are included. 

[0092] The example frefe- shown in FIG. 19 uses the XML method but other encoding 
methods can- may also be used for presentation. That is, i n th e pr e s e nt i nv e ntion, which the data 
shou l d to_be used is of primary importance, and the method fef-gfexpressing the data can be 
p e rform e d by s ele ct i ng to may use a markup language, or a binary table, or another method. 

[0093] Data that can b e included in subtitle/video mapping information cart- may be arranged 
as follows. FIG. 20 is a diagram showing an example of the mapping information described in 
tbe-a_form of a table implemented on a bluray disc as anoth e r e mbod i m e nt (2) of th e pr ese nt 
inv e ntion . Referring to FIG. 20, position information of subtitle data corresponding to a video 
clip is included (2002). Besides AdditionaHy , language information, title information, font 
information, ISRC information, color table information, and stream ID information can- may be 
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included. 

[0094] FIG. 21 is a diagram explaining tbe-a_structure of the subtitle data shown in FIG. 6 
implemented on a bluray disc as anoth e r e mbod i m e nt (2) of th e pr e sent i nv e nt i on . R e f e rr i ng to 
As shown in FIG. 21, subtitle data accord i ng to anoth e r e mbod i m e nt (2) of th e pr e s e nt i nv e ntion 
includes header information, reference offset information, time information and/or text 
information. The header H e ad e r information and text information are the same as explained 
above with reference to FIG. 6. 

[0095] However, the reference offset information is reference information to randomly search 
for a subtitle of a desired time at a high speed and reproduce the subtitle, and uses reproduction 
time information (presentation time stamp, PTS) of the start position of a clip described above, 
which is used as a recording unit of a bluray disc storage medium. Also, as synchronization 
time information, a relative time to a starting time point of reproduction of a clip is used. In 
particular, synchronization time information can- may be expressed by using a presentation time 
stamp (PTS) time based on th e bas i s of a reference time to reproduce moving pictures. 

[0096] Besides Additionallv , style information specifying the output style of pixel data and 
control information for controlling output of converted pixel data can- may be included. The style 
information and control information wW-teeare explained Jatefbelow. 

[0097] FIGS. 22A and 22B are diagrams showing an example of subtitle data implemented 
on a bluray disc displayed on a screen^ as anoth e r pr e f e rred embodim e nt (2) of th e pr e s e nt 
i nv e nt i on. Referring to FIGS. 22A and 22B, the subtitle data described with reference to FIG. 21 
is parsed by the subtitle processor 840 el-shown in FIG. 8 and converted into pixel data having 
an output image as shown in FIGS. 22A and 22B, and transferred to the blender 850. 
Accordingly, the reproducing apparatus according to th e pr e s e nt i nv e nt i on can receive the pixel 
data for a bitmap image according to th e pr e s e nt i nv e ntion as the conventional bitmap-based 
presentation data of a bluray disc, svnchronize-ti- the pixel data with video data and output the 
synchronized pixel data and the video data on the screen. As a result, without modifying the 
structure of the conventional decoder 830, a subtitle can -may be processed to be compatible 
with the conventional presentation method of a bluray disc. 

[0098] The text-based subtitle data accord i ng to th e pres e nt i nv e nt i on described above has 
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the following structure in order to be compatible with the presentation method of a bluray disc as 
described above. FIG. 23 is a diagram showing an example of subtitle data implemented by a 
markup language on a bluray disc as anoth e r e mbod i m e nt (2) of th e pr e s e nt i nv e nt i on . 
Referring to FIG. 23, when the text-based subtitle data is randomly searched for, in order to 
search for the data at a high speed a storage medium accord i ng to th e pr e s e nt i nv e nt i on uses 
the reproduction start time point (sync-offset value) of a video clip. Also, information indicating 
next reference offset information (next) is included. .Also, text information including the contents 
of a subtitle and style information indicating an output style are included (2302 and 2306). 
Furth e rmor e Further , control information for outputting pixel data obtained by converting a text 
subtitle after synchronization with video data is also included (2304 and 2308). 

[0099] Pr e f e rab l y, in ln order to generate the pixel data as shown in FIGS. 22A and 22B 
based on the subtitle data of FIG. 23, style information described with reference to FIG. 16 is 
may be included in the text-based subtitle data according to th e pr e s e nt inv e ntion . The subtitle 
processor 830 parses the style information in subtitle data having the information described 
above and controls the output style of subtitle text. 

[00100] M e anwh ile , pr e f e rab l y, i n ln order to control se4hat svnchronization of the pixel data 
converted by applying the style information described above is synchroniz e d with the video data 
and toputput the synchronized pixel data and video data on the screen, the following control 
information is included. 

[00101] Pr e f e rab l y, i n the controK ^gntrol information included in the subtitle data accord i ng to 
th e pr e s e nt inv e nt i on, may include position information (cropping) specifying an area to be 
actually output on the screen among pixel data, information on a starting point (pixmap position) 
in a pixel data area corresponding to the first starting point of a text subpicture display area 
(Text SP Display Area) shown in FIG. 22A, and time information (composition begin end) on 
when the bitmap image of pixel data appears and disappears on the screen ar e r e cord e d . 

[00102] In FIG 23, subtitle data information for outputting a subtitle in which a reproduction 
start time of a clip is '0' is shown. That is, by using the reproduction start time information of a 
clip that is reference offset information, when text-based subtitle data is randomly searched for, 
retrieval can b eis quickly performed. 
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[00103] Also, <text> tag indicates style information and subtitle text information and 
<composition> tag indicates control information for outputting pixel data. 

[00104] As 'begin' or 'end' information of <composition> tag or <text> tag, a lapse time from a 
reproduction start time of a clip or PTS time information calculated from the standard time clock 
(STC) described above is appropriate. Also, 'start' information of <text> tag indicates address 
information of a starting point from which text is rendered and 'position' information of <pixmap> 
tag indicates information on an address from which pixel data is to be output. 

[00105] In addition, as an example of control information, synchronization time information for 
outputting subtitle data synchronized with video data eafh mav be expressed as a relative time 
based on th e basi s of the reproduction start time point of a video clip, and in particular, screen 
output time (Presentation Time Stamp, PTS) information based on a STC used by a reproducing 
apparatus to reproduce video data ean- mav be used. 

[00106] The example shown in FIG. 23 uses the XML method . However but this i s just an 
e xamp le and the contents of subtitle data including style information and control information, 
reference offset information and header information, described above ean- mav be expressed by 
other encoding methods. A case where subtitle data is expressed by a binary table method not 
by th e XML m e thod will now be explained. 

[00107] FIG. 24 is a diagram showing an example of subtitle data implemented in the-aform of 
a binary table on a bluray disc as anoth e r e mbod i m e nt (2) of the pr e s e nt inv e nt i on . 

[00108] Referring to FIG 24, unl i k e i n F I G. 23, an an example of subtitle data implemented in 
the form of a binary table shape is shown. Subtitle- As shown in FIG. 24, the subtitle data 
according to th e pr e s e nt i nv e nt i on includes style information 2410, control information 2420, and 
text information 2430, and includes header information indicating starting positions of these 
information items. The detailed structure is explained above with reference to FIG. 17. 

[00109] In particular, by implementing each of the style information and control information to 
have a predetermined size and to be stored sequentially in a predetermined area, search time 
for random search and reproduction can b eis reduced compared to the conventional XML 
structure such as SAMI technology and Real-text technology, such that efficiency of search is 
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enhanced. 

Opt i mum e mbod i m e nts hav e b ee n e xp l a i n e d abov e and ar e shown. How e v e r, th e pr e s e nt 
i nv e nt i on i s not li m i ted to the pr e f e rr e d e mbod i m e nt d e scr i b e d abov e , and i t is appar e nt that 
var ia t i ons and mod i f i cat i ons by tho se s k i l le d i n th e art can b e e ff e ct e d w i th i n th e spir i t and scop e 
of th e pr e s e nt i nv e nt i on d e f i n e d i n th e app e nd e d claims. 

[00110] The present invention can also be embodied as computer readable codes on a 
computer readable recording medium. The computer readable recording medium is any data 
storage device that can store data which can be thereafter read by a computer system. 
Examples of the computer readable recording medium include read-only memory (ROM), 
random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage 
devices, and carrier waves (such as data transmission through the Internet). The computer 
readable recording medium can also be distributed over network coupled computer systems so 
that the computer readable code is stored and executed in a distributed fashion. 

I ndu s trial Appl i cab ili ty 

[00111] As described above, by using the mapping information and the subtitle data file 
structure according to the embodiments of the present invention, subtitle information compatible 
with a bitmap image method such as the subpicture method of a DVD and the presentation 
method of a bluray disc, and based on text corresponding to moving picture data having a 
plurality of playback routes can be provided. 

[00112] Furth e rmore, by By including reference offset information in a subtitle data file, when 
random search or reproduction is performed the time for searching for a subtitle eaf hmav be 
reduced such that search efficiency can b eis enhanced. 

[00113] Although a few embodiments of the present invention have been shown and 
described, it would be appreciated by those skilled in the art that changes may be made in this 
embodiment without departing from the principles and spirit of the invention, the scope of which 
is defined in the claims and their equivalents. 
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